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Processing Digital Data 

BACKGROUND TO THE INVENTION 
Field of the invention 

The present invention relates to: a method of processing digital data; apparatus 
5 for processing digital data; a computer program for processing digital data; a data 
format; a method and apparatus for restoring the processed data; and a corresponding 
program, Soirie aspects and embodiments of the invention relate to processing audio 
signals, but it will be appreciated that in other aspects and embodiments the invention 
may be applied to other data. The other data may be audio/visual data* video data* still 
10 image data> a Computer program, and multimedia data amongst other examples. 
Description of the prior art 

EP-A-1, 189,372 (Matsushita) discloses many techniques for protecting audio 
signals from misuse. In one technique, audio is compressed and encrypted before 
distribution to a user. The user needs a decryption key to access the audio. The key 

15 may be purchased by the user to access the audio. The audio cannot be sampled by a 
user until they have purchased the key. Other techniques embed an audible watermark 
in an audio signal to protect it. In one technique, an audio signal is Combined with an 
audible signal (also referred to as a watermark) according to a predetermined rule. The 
watermark degrades the audio signal. The combination is compressed for transmission 

20 to a player. The player can decompress and reproduce the degraded audio signal 
allowing a user to determine whether they wish to buy a 'Tcey^ which allows them to 
remove the wateim^k/ The watermark is removed by adding to the decompressed 
degraded audio signal an equal and opposite audible signal. The watermark may be 
any signal which degrades the audio. The watermark may be noise. The watermark 

25 may be an announcement such as "This music is for sample playback", 

Co-pending UK patent application 0202737.3 (Sony United Kingdom Limited) 
filed 6 February 2002 discloses a method of modifying a compressed video bitstream 
for applying a watermark to the video. The bitstream includes digital codes 
representing the compressed video. At least one digital code is selected. The code 

30 occupies a part of the bitstream which is to contain at least one watennark code which 
represents a watermark perceptible in the information signal, The selected digital 
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code(s) are removed from the said part of the bitstream. The watermark code(s) are 
put in the said part of the bitstream in place of the selected code(s). The number of bits 
of the selected code(s) removed from the said part of the bitstream is greater than or 
equal to the number of bits of the said watermark code(s) put in the said part. The 

5 removed selected code(s) are encrypted and appended to an end of the bitstream and/or 
placed in watermark user data fields created in the bitstream. 

WO 02/5 1 1 50 discloses a system in which an audio signal is transmitted in the 
blanking period of a video signal. Compressed video information and compressed 
audio information are reproduced from a DVD. The video is decoded by a computer. 

10 The^ computer encrypts the decoded video. The computer also encrypts the 
compressed audio. The computer outputs the encrypted video and the encrypted audio 
via a cable. 

US-A-6 041 160 combines, in a multiplexer, encoded audio information with 
compressed video which has been at least partially scrambled. 
15 ... US-A 1 -2002/0 1 08043 generates MPEG encoded data which comprises audio 

and video information. A switch has two inputs: one is connected to receive the 
MPEG encoded data directly and the other via an encrypting device. The switch 
selects one or the other input to generate partly encrypted MPEG data. 

US-A-4 266 243 comprises a mixer which combines composite video signals 
20 with scrambled and compressed audio signals. The audio signals are scrambled in a 
scrambling device and then the scrambled audio is compressed in a compressor before 
being applied to the mixer. 

GB-A-2 369 022 (Radioscape Limited) describes the delivery of audio files by 
digital radio, 

25 An incomplete and/or partly corrupted audio file in compressed form, is 

transmitted. as a first data stream by digital radio "in the clear" (i.e. unencrypted). An 
audio file of n frames is made incomplete by removing n- m frames, leaving m to be 
transmitted. The file is corrupted by corrupting m-p of those frames leaving p 
uncorrupted frames to be transmitted "in the clear \ 

30 A second data stream referred to as a "delta stream" comprising the n-m 

removed frames and the m-p original (uncorrupted) frames totalling n-p frames. Those 
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n-p frames are encrypted. In one example those n-p encrypted frames are embedded 
within extra space allocated within the audio frames themselves. 

The receiver is able to reassemble the original audio file by reinserting the h-m 
removed frames from the second stream into the first data stream and replacing the m- 
5 p corrupted frames in the first data stream with the m-p original frames taken from the 
second stream. 

Summary of the Invention 
According to a first aspect of the present invention there is provided method of 
processing a digital audio signal comprising the steps of: 
10 a) providing a digital audio signal representing unimpaired audio 

information; 

b) compressing and encrypting the said digital audio signal to produce a first, 
compressed and encrypted, audio signal the audio information of which is substantially 
unimpaired compared to that of the said digital audio signal; 
15 c) producing an unencrypted second audio signal; and 

d) combining the said first and second audio signals to produce a 
combined signal comprising the said compressed and encrypted first audio signal and 
the unencrypted second audio signal. 

The digital audio signal is preferably losslessly compressed but it may be 
20 compressed by a "lossy" process. Thus the first compressed and encrypted audio 
signal is preferably an unimpaired representation of the digital audio signal due to the 
loss less compression, but may be a substantially unimpaired representation to the 
extent the lossy compression has resulted in the loss of some data. 

Because the first audio signal is (substantially) unimpaired, it is recoverable 
25 simply by separating it from the second audio signal and decrypting it, which is a 
relatively straight forward process. It does not require reassembling using data from 
another signal (c.f. Radioscape) which is a relatively complex process. 

Because the first audio signal is encrypted it is secure from unauthorised use. 

The second signal is unencrypted and thus can be reproduced easily. 
30 Preferably, the first audio signal is compressed and subsequently encrypted. 

Most preferably, the encryption algorithm used to encrypt the first audio signal does 
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not significantly increase the number of bits of the first audio signal. A small increase 
in the number of bits may be acceptable. 

The compression reduces the amount of data and the encryption transforms the 
compressed data into noise. The first signal then appears to a user to be noise in the 
5 combined signal. 

The second signal may be an impaired version of the (unencrypted and 

uncompressed) digital audio signal or a further audio signal. 

Where the second signal is an impaired version of the original digital audio 

signal, a user may listen to the second signal (which is not encrypted) to determine 
0 whether they wish to access the original digital audio signal. If they do wish to access 

the original digital audio signal, that signal can be reproduced from the compressed 

and encrypted first signal. The original digital audio signal is kept secure from misuse 

in that the user cannot access it without a decryption key whilst the impaired second 

signal can be used by the user without decryption. 
5 The second signal may be an impaired and compressed version of the first 

signal in which case a user needs a suitable decompressor to access the impaired 

signal. 

A second aspect of the present invention provides, in a system comprising a 
transaction server and at least first and second clients, a method of transferring a 
0 digital signal representing content from the first client to the second client; the method 
comprising the steps of: 

using the first client to implement the method of said first aspect of the 
invention to produce the combined signal, and associate an identifier with the 
combined signal for identifying the combined signal; 
5 providing, to the transaction server, the identifier and at least one key for 

decrypting the encrypted signal and storing, in the transaction server, the said identifier 
and the said at least One key; 

transferring the combined signal to the second client; 
deriving the said identifier associated with the combined signal; 
) transferring the identifier from the second client to the transaction server; 




subject to predetermined conditions being satisfied, transferring from the 
transaction server to the second client at least one key associated with the said 
identifier, for decrypting the encrypted first signal; and 

using the second client to separate the first signal from the second signal and to 
5 restore the first signal. 

According to a third aspect, there is provided, in a system comprising at least 
first and secohid processors, a method of transferring a digital signal representing 
content from the first processor to the second processor the method comprising the 
steps of: 

10 using the first processor to implement the method of said first aspect of the 

invention to produce the combined signal and to associate an identifier with the 
combined signal for identifying the combined signal; 
storing the said identifier- 
transferring the combined signal to the second processor; 
1 5 at the said second processor, deriving the said identifier associated with the 

combined signal; 

subject to predetermined conditions being satisfied, transferring to the second 
processor at least one key associated with the said identifier^ for decrypting the 
encrypted first signal; and 
20 using the second processor to separate the first signal from the second signal 

and to reproduce the first signal. 

A fourth aspect of the invention provides a method of processing a digital 
signal comprising the steps of 

providing a first digital signal representing first information, 
25 providing a second digital signal, and 

embedding the first signal in thie second signal by replacing Less Significant 
Bits (LSBs) of the second signal by bits of the first signal and retaining the More 
Significant Bits (MSBs) of the second signal, 

whereby the first signal occurs as noise in the second signal. 
30 Preferably in the fourth aspect the first signal is a compressed signal and/or an 

encrypted signal. 
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A fifth aspect of the invention provides a method of processing a digital signal 
comprising the steps of 

providing a first digital signal representing substantially unimpaired first 
information, the first signal being a compressed and/or encrypted signal, 
5 providing an unencrypted second distal signal representing second 

information, and which is compressed according to a compression format having 
auxiliary data space, and 

combining the first signal comprising the said substantially unimpaired first 
information with the second signal, embedding at least part of the first signal being 
10 embedded in the said auxiliary data space of the second signal. 

In the fifth aspect, part of the first signal may be appended to the second signal. 
A sixth aspect provides a method of processing; a digital signal comprising the 
■ steps of 

providing a first digital signal representing first information, 
15 providing a second digital signal, and 

embedding the first signal in the second signal by selecting groups of N 
samples and distributing over the N samples of each group corresponding sets of M 
bits of the first signal, where the ratio M/N is an integer fraction. 

In the fourth fifth and sixth aspects, the first signal preferably represents a 
20 computer program and the second signal preferably represents an audio signal. Thus in 
an example of the fourth, fifth and sixth aspects a computer program may be combined 
with a music track the combination being recorded on a recording medium for example 
a compact disc. 

These and other aspects of the invention are set put in the claims to which 
25 attention is invited. The features of the claims may be combined in combinations other 
than those explicitly set out in the claims. 
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Brief Description of the Drawings. 

For a better understanding of the present invention^ reference will now be made 
by way of example to the accompanying drawings in which: , 

Figure 1 is a schematic, block diagrain of a first illustrative system for 

5 processing audio signals in accordance with the present invention; . 

Figure 2 is a schematic block diagram of a second illustrative system for 
processing audio signals in accordance with the present invention; 

Figure 3 is a schematic block diagram of a third illustrative system for 
processing audio signals in accordance with the present invention; 
10 Figure 4 is a schematic block diagram of a fourth illustrative system for 

processing audio signals in accordance with the present invention; 

Figure 5 is a schematic block diagram of a fifth illustrative system for 
processing audio signals in accordance with the present invention; 

Figure 6 is a schematic block diagram of a sixth illustrative system for 
15 processing audio signals in accordance with the present invention- 
Figure 7 is a schematic block diagram of a seventh illustrative system for 
processing audio signals in accordance with the present in 

Figure 8 is a schematic block diagram of an eighth iDustrative system for 
processing audio signals in accordance with the present invention; 
20 Figures 9 to 14 are illustrative data structures in accordance with the invention; 

Figure 15 is an illustrative block diagram of an audio signal player in 
accordance with the present invention; 

Figure 16 is a flow chart illustrating the operation of the player of Figure 15; 
Figure 17 is a schematic diagram of a networked system in which the present 
25 invention may be used; 

Figure 18 is a flow chart illustrating a method of distributing bits of audio 
signal amongst samples of audio signal; and 

Figure 1 9 is a flow chart of a method of reversing the process of Figure 18. 
In the Figures, like elements are denoted by like reference signs. 
30 The present invention is described in the following by way of example with 

reference to audio signals. 

Compression and Encryption of Audio Files 
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Referring to Figure 1 , a source 1 of original digital audio is provided. The 
audio in this example is in the form of a file. The digital audio is uncompressed in any 
suitable format, for example, PGM, WAV, AIFF (Audio Interchange File Fonnat). The 
digital audio may be in fixed point fonnat or in floating point format. The following 
5 description assumes fixed point format, although a section below comments on 
floating point fonnat. The source maybe any suitable source, arid in this example may 
be a computer. The original digital audio is compressed by a compressor 2, which 
implements a standard lossless compression algorithm to produce a compressed audio 
file. It will be appreciated that other compression algorithms may be Used. The 

10 compression achieved by the compressor 2 depends on the content of the audio. The 
"compressed audio is encrypted by an encryptor 4 which implements a standard 
encryption algorithm which does not significantly increase the size of the coriipressed 
audio file to produce a losslessly compressed and encrypted audio file. A small 
increase in the number of bits may be acceptable. Such an increase may be due to the 

15 provision of Cyclic Redundancy Code information for example. Rijndael is one 
example of such an encryption algorithm: others may be used. The encryption 
algorithm uses at least one key. The key or keys needed to decrypt the file are securely 
stored in a store 3 for use in decrypting the audio later. 

Combining the first, compressed and encrypted, audio signal with a second 

20 audio signal 

In the example of Figure 1, the first signal, which is the compressed and 
encrypted audio, is combined in a combiner 8 with a second audio signal from a source 
6. The encryption of the first signal from source 1 creates a signal which appears to be 
noise to the human ear in the combined signal because of the randomising effect of the 

25 encryption. The second signal from source 6 is any audio signal. One example is an 
announcement. An example of an announcement lets a user know what the original 
audio from source 1 is and how they can obtain the key or keys for decrypting the 
original audio. In other examples, described in more detail below, the second signal is 
an impaired version of the original audio. In this example the second audio signal can 

30 be intelligibly reproduced at least without decryption and preferably without 
decompression even when combined with the first signal from source 1. 
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The combined signals, which in this example are a file, are then stored in a 
store 9, and/or provided to a transmission system 9, and/or recorded on a suitable 
recording medium 9 indicated as distribution material in Figure 9. The transmission 
system may be a "pull" system for example the Internet or a "push" system for 
5 example any broadcast system including DAB (Digital Audio Broadcast) and DVB 
(Digital Video Broadcast). 

The example of Figure 1 has been described as if the compressor 2, encryptor 
4, and combiner 8 are discrete hardware elements. Whilst they may be such, the 
system of Figure 1 may be implemented in software for operation on a cbitiputer, 
10 Figure 2 differs from Figure 1 by showing details of an example of the source 6 

of the second signal. In this example the source 6 provides to the combiner 8 an 
impaired version of the original audio from source 1. The impaired audio in this 
example is reproducible without decryption and decompression when combined with 
the; original audio, which appears as noise in the combined signal. This allows a user 
15 to hear an audition signal, which is an impaired version of the original audio, without 
allowing them access to the original unimpaired audio. 

Mixing a spoiler signal with an audio signal 

As shown in Figure 2, the source 6 preferably comprises a mixer 12 which 
mixes original audio from source 1 with a spoiler signal from a source 11 to produce 

20 an audition signal. The mixer is an additive mixer and the output of the mixer is the 
audition signal. The relative amplitudes of the original audio arid the spoiler in the 
audition signal are a matter of judgement. If the level of the spoiler is too small with 
respect to the original audio it may be encourage unauthorised attempts at removal. If 
its lev0l is too high it will ina^sk the original audio too much. The audition signal is 

25 combined with the compressed and encrypted original audio in the combiner 8 to 
produce the distribution materials. The spoiler signal may be any signal. An example 
of a spoiler signal is an announcement as described above. The source 11 of spoiler 
signals may store a suite of different signals which may be chosen according to the 
audio to be spoilt. 

30 Modulating the spoiler signal 

Figure 3 shows a modification of the system of Figure 2, in which a modulator 
14 is provided. The modulator 14 modulates the spoiler signal to make it more difficult 
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to remove. The modulation may be any suitable modulation including for example 
reverberation, phase modulation and pitch shifting. 

Figures 1 to 3 show systems which allow the second signal from source 6, 
which may be an impaired version of the original signal, to be reproduced without the 

5 need for decompression and decryption. Thus in the case of the second signal being an 
impaired version of the original audio from source 1, the audition signal has the same 
format (albeit spoilt) as the original audio and can be reproduced using any player 
capable of reproducing the original audio from source 1. 
Compressing the audition signal 

10 Figures 4, 5 and 6 show systems which are modifications of the system of 

Figure 2. They differ from Figure 2 by the addition of a compressor 16 in Figure 4 and 
18 in Figures 5 and 6. The compressor 16 or 18 compresses the MSB s of the audition 
signal. The LSBs are removed before compression because they are replaced by the 
first, compressed and encrypted audio, signal as described below. The Systetii of 

i5 Figure 3 including the modulator 14 may be modified in the way shown in Figures 4, 5 
and 6. In Figure 4, the compressor \& operates according to a lossless compression 
algorithm and may be the same as compressor 2. In Figures 5 and 6, the compressor 18 
operates according to a lossy compression algorithm examples of which are 
compression algorithms defined in the MPEG standards. In order to reproduce the 

20 audition signal, a reproducer needs a decompressor corresponding to the compressor 
; 16 or 18. 

Combining the compressed and encrypted audio signal with the audition signal 
The combiner 8 of any one of Figures 1 to 5 may operate in the following way. 
Assume the compressed and encrypted audio signal is in the form of a file and 
25 the audition signal is also in the fbnn of a file. Assume also that both files have the 
same format although that is not essential. Referring to Figure 10, each file contains 
sampled audio, having samples represented by digital numbers having Most 
Significant Bits (MSBs) and Less Significant Bits (LSBs). Each file has a Header 
which may for example identify at least the type of file (e.g. WAV) and the number of 
30 samples in the file. The number of bits per sample may be any number conventional in 
the art, for example 8, 16, 24 or 32. Figure 11 described below assumes 16 bits per 
sample PI, P2....Pn. 
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A) In one example, the LSBs of samples of the audition file are replaced by 
samples of the compressed and encrypted audio signal. Thus in the combined signal 
the MSBs represent the audition file and the LSBs are noise representing the original 
audio from source 1 and occur in the combined signal as noise. 

5 If the audition file is sufficiently long, all the samples of the encrypted and 

compressed audio are placed in the LSBs of the audition file. If the ehaypted and 
compressed audio file does not fill the LSBs of the audition file, then the unused LSBs 
of the audition file may be replaced by zeros or they may be retained unchanged If the 
encrypted and compressed file is longer than can be accommodated by the LSBs of the 
10 audition file, then additional samples of the combined file are created comprising zero 
filled MSBs and LSBs which are the samples of the encrypted and compressed audio. 

The ratio of MSBs to LSBs in each sample of the combined signal file may be 
fixed, or alternatively it may be variable. Referring to Figure 1 1, at least when the ratio 
is variable and preferably also when the ratio is fixed, data h is provided in the 
15 combined file indicating the boundary between the MSBs and the LSBs. For a fixed 
ratio, the data h may be provided once in the file at the head of the file, It is added to 
the encrypted data represented by the LSBs as shown in Figure 11. If the ratio is 
variable, the data h is provided at each position where the ratio changes. 

The ratio of MSBs to LSBs may be chosen as a function of the lengths of the 
20 file of the audition signal and of the file of the compressed and encrypted audio signal. 
Bit Distribution 

B) Referring to Figure 18 another method (which is referred to herein as ''Bit 
Distribution") of distributing the bits of the compressed and encrypted signal over 
samples of the audition signal is as follows. 

25 This explanation assumes that a file of audio is processed as shown in Figure 2. 

The original audio has n-bit samples which are compressed by compressor 2 and 
encrypted by ehcryptor 4 by an encryption algorithm which does not significantly 
change the number of compressed bits. By way of example assume 10 seconds of 
stereo audio sampled at 48kHz with 16 bit samples and a compression ratio of 0.65. 

30 The number of audition samples is then 48000*2*10 = 960000. The number of 
compressed bits is 0.65* 960000* 1 6 - 9,9S4,000. 
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At step S50 the ratio of thfe number of compressed bits to the number of 
uncompressed audition samples is calculated. For this example the ratio is 10.4. 

At s£ep S51 , that ratio is converted to a simple integer fraction M/N equal to or 
greater than the said ratio, where M and N are low integers. 10.4 =" 52/5. Thus M = 
5 52 bits are to be distributed over each set of N = 5 samples as the LSBs of those 
audition samples. (In practice it is desirable to choose a value of M which is less than 
the word length of the computer on which the method is implemented to keep the 
subsequent processing simple. M and N are stored (S511) to enable the subsequent 
reversal of the process. 
10 At step S52 a value S==2 R is calculated. R equals M/N. 

At step S53, a group of N 5 samples arid M = 52 bits is obtained. Header data 
is added to the bitstreain to indicate the group. For the purposes of the following 
explanation assume the M bits represent an M bit number of value V. The samples are 
ordinally numbered 0 to N-l, in this example 0, 1, 2, 3 and 4. 
15 At step S54 set X = N-1. 

At step S55, A'[X] = ((A*(F-S)/F)/S)*S is calculated for each of the N 
samples, where A is the range of the audition sample. This scales the valuie of A and is 
termed a scaled value below. 

By way of explanation Step S55 is a combination of two sub-steps which when 
20 combined produce step S55. In the first sub-step each audio sample is pre-scaled 
according to A*[X] = A[X|*((F-S)/F) so it fits in the range -(F + S) . . ..(F - S). F is the 
maximum value which a sample can take. For a 16 bit sample F .= +A 2 I5 -1. The 
second sub-step scales each pre-scaled audio sample A'[X] according to A"[X] = 
(A'[X]/S)*S so that it has a value in set { -(F+S), -2S, -1 S, 0, 1 S, 2S ..F-S} 
25 At step S 56 replace the current scaled value A" by a new value A'[X] + V/S x 

where A'fX] is the ordinally numbered scaled value. This adds the bits representing 
V/S x to the scaled value A"[X].. 

At step S57, V is replaced by V -V/S* 

At step S58, if N is not 0 then N is decremented by 1 and another set of bits of 
30 V are added to the next sample by steps S55 to 57. If N = 0 then the 0 th sample is 
replaced by A*[0] + Vmod S which has the effect of adding the remaining value of V 
to the 0 th sample. 
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Referring to Figure 19, the method of extracting the M original bits from the 

combined bitstream is as follows. 

Starting at step S62, the group of N samples A' are Obtained and at step S63. X 
arid V are set initially to 0. Then at step S64 the current value of V is replaced by a 
5 hew value V + (A'[X] mod S ) * S x . Thus for the first calculation X= 0 so V = 
A'[0]mod S. 

If X is not Nrl at step S65, then X is incremented by one at step S66 and V 
replaced by the new value at step S 64. That cycle repeats until all N samples have 
been processed, the final value of V = V+A[4]modS*S 4 being the restored original 
10 . bits. 

O Referring to Figure 6 the encrypted material file is appended to the audition 
file as is shown schematically in Figure 13. Alternatively, encrypted material is 
inserted as a non-audio section in the combined file. 
Reducing the size of the combined file. 
15 It is possible that, for a given file-size of the combined file, when using the 

combining method A described above, the number of MSBs representing the audition 
signal in the combined signal may be too small to provide an adequate audition signal 
for a user to hear but it is not desired to increase the size of the file. It is possible to 
make more space available for the MSBs representing the audition signal, if the 
20 audition file is a multi-channel file, by converting the file to a single channel (mono) 
file. The compressed and encrypted audio may be placed in the I£Bs Of the audition 
signal by any of the methods described above. Any encrypted audio which cannot be 
fitted into the LSBs of the audition file may be appended to the audition signal (see 
Figure 13), or inserted into the combined file as a non-audio section. 
25 In one method, if the file has two channels, (i.e. it is a stereo file), each of 16 

bits and 7 bits are needed for the audition signal, then the two channels may be 
converted to one mono channel of 32 bits. That increases the bits available for the 
compressed and encrypted signal from 2*(16-7) {i.e. 1 8] to 1*(32^7) = 25. 

In another method, provided the number of bits per sample is greater than the 
30 number of channels the format of the original signal can be maintained and each 
channel of the signal is replaced by a mono fold-down of all the channels. As the 
mono signals are coherent, this has the effect of making the audition content of the 
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distribution file perceptibly louder (for each added channel). The noise is incoherent, 
so remains at an unchanged perceived level. Consequently, an extra MSB in the 
_ audition file may be made available to the encrypted material (for each of the original 
channels) without loss pif perceived quality except for loss of the multi-channel audio 

5 ' image,. 

A further method produces a single mono representation of the original signal, 
reduced to the size of one of the original channels: This greatly reduces the file size, 
allowing any excess CTCi^pted data (after the merge operation) to be appended to this 
file (or inserted as a non-audio section). 
10 A method for reducing the file-size of the combined file, which may be 

acceptable in some circumstances, is to reduce the sample-rate of the samples in the 
audition file, using standard down-conversion algorithms. This has the effect of 
~ reducing the frequency range of the audition signal and also effectively decreasing the 
file-size of the audition signal relative to the original. Encrypted audio is placed in the 
15 LSBs of the samples as described above. Any encrypted audio which cannot be fitted 
into the LSBs of the audition file may be appended to the audition signal (see Figure 
13), or inserted into the combined file as a non-audio section. 

Converting a multi-channel file to a single channel file as described in this 
section may also be used in conjunction with the combining method B (Bit 
20 Distribution) described above, 
MPEG Compression 

Referring to Figure 7, the compressor of the audition signal may be an MPEG 
compressor. An MPEG data structure has data space which may be used for auxiliary 
data and data space for the compressed audio as is shown in simplified and schematic 
25 form in Figure 14. In this example, the compressed and encrypted audio signal is 
. placed in the auxiliary d£ta space of the MPEG data structure. 

Thus the audition signal can be reproduced using an MPEG reproducer. 
Compression formats other than MPEG may provide equivalent auxiliary data 
space. MP3 may be used for example with auxihary data space therein. 
30 In addition to, or as an alternative to using the auxiliary data space, the 

compressed and encrypted audio may be appended to the end of the MPEG data 
structure as shown in Figure 13. 
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Techniqties using blocks, segments or sections of audio . 
Partial encryption and decryption . 

In some situations it may be desirable to allow only sub-sections of the original 
material to be extracted from the distribution material. In this case, as the original 
5 file is being compressed in compressor 2, it is split into segments of a fixed length 

(e.g. lsec, 5 sec, lOsec), or into sections at specified points- In the example of an 
audio track of a film or video, the sections may correspond to scenes. In this 
example, different encryption keys are used to encrypt the different s^ments or 
sections, and saved in a lookup file for later decryption. In this example, the 
10 compressed/encrypted file must contain information at determinable points 

(normally section or segment boundaries) * which indicate which section or 
segment of the original audio is contained within that section or segment This 
information is necessary, as the compression obtained is not constant throughout 
the compression process^ so there is not a fixed method for calculating position in 
15 the original material from position in the encrypted/compressed version. The 

compression/encryption in this mode can be done in one of several different ways, 
two of which are mentioned here: 

1. The whole file is compressed in a single pass. This generally produces 
the most efficient compression ratios, but requires that section or segment headers are 
20 placed in the compressed file during the compression process. The headers BH are 
placed at block boundaries to indicate what part of the original audio is contained in 
the following section or segment; see Figure 12. 

Sections or segments of desired length are then separately encrypted, and 
merged with the audition signal using a method as described above. 
25 The sections or segments of the encrypted data may be organised as 

follows: 

a) Referring to Figure 9, the sections or segments are based on the header 
data BH inserted during compression. Section or segment headers SHI , indicating the 
encrypted sections or segments , are provided in the encrypted data. The headers 
30 include location start data plus block length data, block ID data and possibly other 

data. The location start data is extracted from the compressed data headers BH during 
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the encryption process. This allows a section or segment to be located without needing 
to decrypt the data. 

b) Alternatively, section or segment header data is not included in the 
encrypted data, in which case it is then necessary to rely on the headers of the 
compressed data to locate a section or segment. That requires decrypting at least some 
of the segments to locate the headers in the compressed data. 

2. The original file is split into the desired segments or sections, each of 
Which is compressed and encrypted separately. The resulting compressed and 
encrypted sections or segments are then concatenated as shown in Figure 9. . in this 
case, the segment location information SH only needs to be embedded in the encrypted 
file although it is not encrypted itself The compressed and encrypted file including the 
headers SH is then combined with the audition signal (as in the methods described 



A modificati on which is applicable to both of the above segmented 
15 encryption methods is to place a complete lookup table LUT of segment/offset 

informa^on at a known place in the encrypted or compressed file; which enables the 

correct segment or section to be located quickly. 

In this variant, decryption and extraction is similar to that described in the 

method described above. When a valid request is received to extract a segment or 
20 section of the distributed file, the key(s) for the segment or section is/(are) retrieved 

from the lookup file, the segment or section is located in the encrypted data (LSBs) of 

the distributed file, using the information saved in the block header(s), and the sections 

or segments decoded. 

If a user requests the extraction of a portion of the audio which is longer than 
25 one segment or section but does not coincide with section or segment boundaries, then 
Whole sections or segments which include the requested portion are extracted to allow 
correct decryption and decompression. However, more data is extracted than is 
requested. Thus blocks which contain audio samples outside the requested segment are 
extracted. These are discarded after decryption and decompression. When choosing a 
30 basis for the original file segmentation, care should be taken to ensure that the 

decodable segments sizes and the permitted extraction request sizes do not allow large 
numbers of samples to be decoded outside requested portions of audio, as they are 
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potentially available for unauthorised use. This potential security gap is completely 
avoidable if permitted segment extracti on ex actly follows encoding lengths (eg on 10 
second boundaries), or the original material is explicidy encoded in segments and 
extraction requests are restricted to those segments. 
5 Adaptive bit-slicing. 

Louder audio signals mask noise better than quiet ones. In this, adaptive bit- 
splicing, variant the signal level of the spoilt material is analysed before or during 
the combining stage and is divided into blocks with different average loudness. 
The blocks maybe either of fixed length, or of variable length determined by 
10 loudness thresholds. The sequence of blocks thus generated may then be combined 

with the encrypted data, using a bit-slice (MSB:LSB ratio) based on the loudness 
of each block. In this method, the compression and encryption of the first signal 
may be performed on the whole of the original material, but the encrypted data is 
also broken into blocks at the same block-boundaries as the audition material with 
15 header information at the start of each encrypted bldck giving the number of 

samples at a given bit-slice, which is required when the encrypted data is 
subsequently extracted when the original is restored. 

This variant may be combined with the with the partial-decryption variant 
(above), by setting a maximum segment size for audio of similar loudness which 
20 allows decryption of the original on the required boundaries. 

Streaming audio. 

In some situations, it may be required that the operation of creating the 
distribution file should start generating output before the whole original audio has 

25 been read. This might be the case if the original audio is received from a network 

connection rather than a file* or the output is being encrypted on-the-fly for 
distribution on a network connection. It is of course not possible to see the whole 
file before compressing or encrypting must start. The procedure to follow is similar 
to that for Partial Encryption- method 2 described above. The main differences are 

30 that: the same encryption key may be used for all blocks; a predetermined block 

length is used; and that it is not always possible to generate a continuous bit-»stream 
for the encoded version of the data, as compression ratios obtained will vary from 
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block to block. There is a choice of strategies, influenced by the actual 
compression ratio obtained for each block of original audio d 
the generated data must not stall waiting for subsequent blocks. 

a If the MSBrLSB split is fi?ced, and the compression achieved does not 
5 permit the encrypted version to fit in the LSB stream (even using all the 

techniques described above), then the extra bits of the encrypted data 
remaining after the. block of distribution data has been packed, then the 
extra bits must be placed at the head of the encrypted data of the next 
block 

10 b K the ]S4SB:LSB split is fixed, and the compression achieved means that 

the encrypted version is smaller than the space available in the LSBs of 
the distribution material, then tte remaining 1^ 
random noise. 

c If the MSB rLSB split is variable, and the compression achieved does 
15 not jpermit the encrypted version to fit in the LSB stream, then either the 

MSBrLSB split is changed so that the all the bits of the encrypted data 
can be accommodated, or (if a practical limit to the split is reached), the 
extra bits of the encrypted data aire moved to the head of the next block, 
d If the MSBrLSB split is variable, arid the compression achieved means 
20 that the encrypted version is smaller than the space available in the 

LSBs of the distribution material, then the remaining bits can be filled 
with random noise, or the MSBrLSB split can be raised to allow more 
MSBs from the audition tone to be heard. 
Note that in cases c and d, it is possible that the SNR of the distributed signal 
25 will vary from block to block if the MSBrLSB split is changed. This is 

probably acceptable where the reason for the good/poor compression was 
because the original signal is quiet/loud in those blocks (louder noise is better 
masked by louder signals), and is the preferred method, as adjacent blocks 
generally obtain similar compression ratios. 
30 The method described in the section Bit Distribution may also be 

applied to streaming audio. 

Floating Point format 
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The pre^ digital audio is represented 

in a fixed point format. However the digital audio may be represented in 
floating point format. Those skilled in the art will recognise that floating point 
format might result in more complex processing. 
5 A Combined System (Figure 8) 

The invention has been described with reference to Figures 1 to 7 which 
individually show respective different methods of processing an audio signal. 
The various methods described above ynay all be ^ implemented by apparatus as 
shown in Figure 8 . Figure 8 will now be described, but the descriptions of the 
10 various methods described above which may be implemented by the apparatus 

will not be repeated here. 

Figure 8 differs from the apparatus of Figure 1 to 7 as follows: 
The compression ratio achieved by the compressor 2 may be measured 
and if the compressor 16, 18, 181 of the audition signal is provided, then the 
15 compression ratio of that compressor 16, 18, 181 maybe controlled in 

dependence on the measured compression ratio. That enables the compression 
of the audition signal to be adjusted to provide an appropriate ratio of 
compressed MSBs representing the audition signal to LSBs representing the 
compressed and encrypted original audio for a given file size. Alternatively or 
20 -additionally, the manner in which the audition signal is combined with the 

vi compressed and encrypted original audio signal may be chosen in dependence 
on the measured compression ratio, which also enables an appropriate ratio of 
MSBs (representing the audition signal) to LSBs (representing flie compressed 
and encrypted original audio) for a given file size to be selected. 
25 Figure 8 also comprises a control panel 20 which may be a virtual 

control panel provided as a graphical user interface of a computer which 
enables a user to set various operating parameters of the apparatus. The control 
panel may set one or more of the following; 

a) The choice of spoiler signal if a suite of spoiler signals is provided. 
30 b) The relative signal levels of the spoiler signal and the signal being 

spoiled. 
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c) The choice of modulation if a suite of modulations is provided as 
described above. 

d) Type of compression provided by the compressor 1 6, 18, 181 of the 
audition signal. Various types of compression are described above. 

5 e) Type of combination of the audition signal and of the compressed 

and encrypted original audio signal. Various types are described above. 

f) The type of block or segment or section of audio. Blocks may be af- 
fixed length or variable. Segments or sections may be j^ed Or variable. They^ 
may be Chosen to correspond to scene changes for example as described above. 

10 The control panel maybe used to designate the scene change locations. 

g) The control panel may be used to add information about the sections 
or segments. 

h) Parameters for raw ( headerless) PCM files such as sample rate, 
sample format etc.. 

15 The system of Figure 8 may be controlled by an operator to select, and 

operate in, one of the manners described above or may be so controlled by a 
computer program. 

Reproducer 

Referring to Figure 1 5, there is shown schematically an example of a 
reproducer ( also referred to as a player). The combined file or bitstream is 
received at an input 50 and fed via a decompressor 51 ( corresponding to 
compressor 16, 18 or 1 81 described above) or directly to a reproduction stage 
54 which is operable to reproduce the uncompressed audition signal. A switch 
53 selects the direct connection to the input 50 or the decompressor 51 
dependent on whether the audition signal is compressed or not. 

If the reproducer is intended to also reproduce the compressed and 
encrypted audio, it farther comprises a separator 55 which separates the 
encrypted and compressed audio from the audition signal, a decryptor 56 which 
decrypts the separated signal using the keys 3, a decompressor 57 and a 
reproducing stage 58 which reproduces the original audio. 
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Referring to Figure 1 6, for a data structure as shown ih for example 
Figurell or 12* the separator 55 parses S2 the bitstream and detects S4 the 
headers to determine where the boundary between LSBs and MSBs lies. The 
MSBs representing the audition signal are then discarded S6 leaving the 
5 encrypted arid compressed audio represented by the LSBs, 

If the first and second signals are combined by the method described in 
the section '^it Distribution'' described above then they are^eparated using tibe 
method described with reference to Figure 1 9. 

The decryption key or keys are then obtained S8 and used to decrypt 
10 S10 the LSBs. The decrypted audio is then decompressed S12. 

For other data structures such as those shown in Figures 13 and 14, the 
combined data structure is parsed S2 to determine the location(s) of the 
encrypted imd compressed a 
Transaction Systems 

15 Referring to Figure 17, the present invention may be implemented as 

part of a system by which audio or any other data is traded. In Figure 17 the 
terms "seller^' and tc buyer" are used for ease of description. Whilst those terms 
may indicate their ordinary meanings implying that a vendor sells the audio to 
a buyer outright in return for payment, they are also used here more generally 
20 to indicate that audio may be made available by a person or organisation (the 

* selibr), who may be acting on behalf of the originator and/or owner of the 

audio, to another person or organisation ( the buyer) who may pay for the use 
of the audio under predetermined business conditions but transfer of the 
ownership of the aiidio does not necessarily occur. 
25 Referring to Figure 17, a first example of a system in accordance with 

the invention comprises a transaction server 62, a seller client 60, a buyer client 61 and 
a communications network 64 linking the clients to the server. 

The owner of material, i .e. the seller, controls the seller client 60. A buyer 
controls the buyer client 61 . In this example, a third party owns and controls the 
30 transaction processor 62 although the transaction processor may be owned and 

controlled by for example the seller. The system allows audio material to be acquired, 
securely and perceptibly spoiled or impaired as described herein above, and -transferred 
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to the buyer for the buyer to audition (69) the impaired audio material. If the buyer 
then wants to buy the original unimpaired audio material, the buyer obtains from the 
transaction server 62 the data needed to access the. unimpaired audi example, 
the seller and buyer both register (651, 652) with the transaction server. The data for 
5 accessing the unimpaired audio is sent from the transaction server to the buyer only 
when the buyer has paid for the material. The payment is monitored by the transaction 
server 62 which communicates with a financial institution 63. Payment is made via 
the server 62 and/or via the institution 63. 

Associated with the seller client 60 is a first apparatus_66 for impairing the 
10 audio material as described above. The apparatus 66 maybe as shown in any of Figure 
1 to 9 and 1 8 and 19. The key(s) needed for decryption of the encrypted audio are 
transmitted from the apparatus 66 to be stored in the transaction server 64 together 
with an identifier which identifies the material.. Associated with the buyer client 61 is 
a second apparatus 68 for accessing the unimpaired audio. Such an apparatus may be 
15 as shown in Figures 15 and 16. 

A content auditioning apparatus 69 is also denoted in Figure 17 in association 
with the buyer client 61 for the purpose of hearing the audition signal. Such an 
apparatus may comprise elements 50, 51, 52 , 53 and 54 in Figure 15 which enable the 
buyer to reproduce the audition signal. 
20 The seller client and the buyer client may be computers which implement the 

impairment of audio and access to the audition signal and the unimpaired audio. As 
part of the registration process, software for implementing the impairment of original 
audio may be provided by the server to the seller client. Likewise software for 
accessing the unimpaired audio may be provided by the server top the buyer client. 
25 In this example the material is audio material and is recorded on a recording 

medium 9, e.g. a tape , disc or other store or is a bitstream form an external source . 
The material is acquired and processed by the first apparatus 66. In addition the 
material identifier is applied to the material. Then the material including the identifier 
is transferred on the medium 9 to the second apparatus 68, 69. The transfer is for 
30 example by post. Alternatively, the audio material may be transferred via the networie 
64. 
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The identifier is applied to the audio material during acquisition or during 
processing of the material to enable the key(s) to be associated with the audio and to 
enable the buyer, seller and transaction server to manage the selling and buying of the 
audio material. An example of an identifier is a Unique Material Identifier or UMID. 
5 UlVODs ^e described in more detail in SMPTE Journal March 2000. 

To obtain the unimpaired audio, the buyer pays for the audio and obtains the 
decryption key(s) from the server 64. 

A system as shown in Figure 17 is described in more detail in European Patent 
Application published as EP-A- 1215 907 which is incoiporated here by reference. 
10 In an alternative example, thCTe is no transaction server and the seller 

communicates directly with the buyer via the network. 

In another alternative example, both a seller client and a buyer client may be 
implemented on the same computer. 

The invention may also be implemented in a peer to peer-network. 
1 5 In yet another alternative, the there is no transaction server 62. The buyer who 

has a buyer processor 6 1 communicates with the seller who has a seller processor 60 
via the network 64 to obtain the combined audio data either via the network or an a 
tape or disc or other recording medium which is sent to the buyer. If the buyer likes the 
audition signal, the buyer pays the seller for the decryption key(s) either directly or via 
20 the financial institution 63 connected to the network. The seller then sends the 
decryption key(s) to the buyer. 

Push Systems and Pull Systems 

The transaction systems described with reference to Figure 17 are "pull 44 
systems in which the buyer requests the seller to transfer the audition signal to the 
25 buyer. 

The present invention may be used in **push" systems an example of which is a 
broadcasting system in which audio is transmitted to all potential users. If a user then 
wishes to acquire the unimpaired audio they then request the issuance of the 
decryption key(s). 
30 Computer Program combined with an Audio signal 

In the foregoing examples, the first signal is a compressed and encrypted digital 
audio signal which is combined with a second audio signal, which is the audition 
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signal. In some examples, the (encryption randomises the first signal so that it appears 
to be noise if it is embedded in the second signal,. In other examples, the second signal 
is compressed and the first signal embedded in auxiliary data space in the compressed 
audition signal and/or appended to die compressed second signal. 

5 In a development of the invention, the first signal is a computer program Which 

may or may not be compressed and which may or may not be encrypted. This example 
assumes it is neither compressed nor encrypted. The second signal is an audio signal. 
The combined signal is recorded on a recordm^ for example a compact disc. 

The computer program is: 

10 a) embedded in the second signal (which may or may not be compressed) according to 
one of the methods described above. In this case the first signal need not be encrypted 
but preferably it is encrypted. If the computer program is compressed it is losslessly 
compressed. 

Alternatively, the computer program is 

15 b) embedded in auxiliary data space in the compressed second signal and/or appended 
to the end of the compressed second signal according to methods described above. 
Preferably it is enoyptekT especially if it is simply appended to the second signal. If the 
computer program is compressed it is losslessly compressed. 

The second signal may be music. The second signal may possibly include an 

20 announcement making clear that a computer program is on the disc and giving 
instructions on how to access it. 
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CLAIMS \; 

1. A method of processing a digital audio signal comprising the steps of: 
a) providing a digital audio signal representing unimpaired audio 
information; 

5 b) compressing and encrypting the said digital audio signal to produce a first 

compressed arid encrypted audio signal, the audio information of which is substantially 

c) producing an unencrypted second audio signal; and 

d) combining the said first and second audio signals to produce isi combined 
10 signal comprising the said compressed and racrypted first audio signal arid the 

unencrypted second audio signal. 

2. A method according to claim 1 v/hereiri the digital audio signal is 
losslessly compressed to produce the said first audio signal. 
15 

3 A method according to claim 1 or 2 y wherein the said first audio signal 
occurs as noise in the said combined signal. 

4. A method according to claim 3, wherein the step of combining the first 
20 and second signals comprises embedding the first signal as noise in the second signal. 

5. A method according to claim 1, 2 or 3, wherein the step of combining 
comprises appending at least part of the first signal to the said second signal. 

25 6. A method according to claim 1; 2, 3 or 4, wherein the step of producing the 

said second si gnal comprises impairing the digital signal. 

7. A method according to claim 5, wherein the step of producing the said 
second signal comprises combining the said digital signal with a third signal which 
30 impairs the digital signal. 
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8. A method according to claim 5, comprising the steps of modulating the said 
third signal and combining the modulated third signal with the said digital signal. 

9. A method according to any preceding claim, wherein the of producing 
5 the first signal comprises compressing the digital signal and encrypting the compressed 

signal without substantially increasing the number of bits of the compressed digital 
' signal. 

10. A method according to any preceding claim wherein ^e said second signal 
is a sampled digital signal, each sample having most significant bits (hereinafter 

10 MSBs) and less significant bits (hereinafter LSBs). 

11. A method according to claim 10, wherein the digital signal is in fixed point 

format. 

15 12. A method according to claim 10 or 11, wherein the first signal is combined 

with the said second signal by replacing the LSBs of the said second signal with at 
least some of the bits of the first signal. 

13. A method according to claim 12, wherein a predetermined fixed number of 
20 LSBs of the said second signal are replaced by at least some of the bits of the first 



14. A method according to claim 12, wherein, in the combined signal, the ratio 
of MSBs (representing the said second signal) to LSBs (representing the bits of the 

25 first signal) is variable. 

15. A method according to claim 14, wherein the said ratio is dependent on the 
amount of compression applied to the first digital signal. 



30 



16. A inethod according to claim 12, 13, 14 or 15, wherein the combined signal 
includes data indicating which bits of the combined signal are LSBs and which bits are 
MSBs. 
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17. A method according to any one of claims 10 to 16, comprising the step of 
reducing the amount of data in the said second signal. 

5 18. A method according to claim 17, comprising the step of reducing the 

sampling rate of the said second signal . 

1 9. A method according to any one of claims 10 to 18, comprising providing a 
file containing the said first signal and a file containing the said second signal. 

10 . 

20. A method according to claim 19, wherein the ratio of MSBs {representing 
the said second signal) to LSBs (representing said first digital signal) is dependent on 
the number of bits in the files of the first signal and of the second signal. 

15 21. A method according to claim 19, wherein the bits of the first signal are 

distributed over samples of the second signal in dependence on the ratio of the total 
number of encrypted bits in the encrypted signal file to the total number of samples of 
the said second signal. 

20 22. A method according to claim 21 , wherein the said ratio is approximated by 

an integer fraction M/N, and comprising the steps of selecting groups of N samples 
and distributing, over the N samples of each group, cM>iresik>nding sets of M bits. 

23. A method according to claim 22, comprising the steps of 
25 a) scaling the value A of each of die N samples according to A'[X] = (A [Xj/S) 

* S where: X is an ordinal numbering of the samples and equals 0 to N^l; and S = 2 
where R is M/N; and 

b) replacing A'[X] by A"[X] = A' [X] + V/S x for X > 0, and 
by A"[0] = A'[0] + mod S for X = 0, 
30 where for each of X= N-l to 0, V is replaced by V-V/S x , V initially being the 

value of the M bits when X=N-1 . 
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24. A method according to any one of claims 1 to 1 1 , wherein the said second 
signal is a sampled digital signal, each sample having most significant bits (hereinafter 
MSBs) and less significant bits (hereinafter LSBs), and comprising the step of 
dividing the said second signal into blocks each block comprising a plurality of 
5 samples. 

25 . A method according to claim 24, wherein all the blocks of the said second 
„ sigpal contain the saime pfedetearnined number of sam^^ 

10 26. A method according to claim 24 or 25, comprising the step of analysing the 

signal level of the said second si gnal, and setting the number of samples per block in 
dependence on signal level. 

27. A method according to claim 24, wherein the number of samples per block 
15 in the said second signal varies. 

28. A method according to claim 27, comprising the steps of analysing the 
signal level of the said second signal, and setting the number of samples in a block in 
accordance with a function of the levels of the signal samples within the block. 

20 

29. A method according to any one of claims 24 to 28, comprising providing, 
in the said second signal, data indicating the boundaries of the blocks. 

30. A method according to claim 29, wherein, in each block, the first signal is 
25 combined with this said second signal by replacing the LSBs of the said second signal 

with bits of the first signal and the ratio of MSBs (representing the said second signal) 
to LSBs (representing the bits of the first signal) in each block is a function of the 
signal levels of the samples of the said second signal in the block. 



30 3 1 . A method according to claim 30, wherein the said data indicating the block 

boundaries includes data indicating the number of samples in each block. 
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32. A method according to any one of claims 1 to 11, wherein the step of 
producing the first signal comprises the steps of compressing and then encrypting the 
said digital audio signal, and wherein at least the step of -encrypting comprises 
selecting sections of the compressed digital audio signal, separately encrypting each 

5 section, and further comprising the step of providing data in the first signal indicating 
the section boundaries. 

33. A method according to claim 32, comprising providing a file containing 
the said digital audio signal to he compressed arid encrypted. 

10 ' : : . , ,■: . . ..; . 

34. A method according to claim 33, comprising the steps of compressing the 
whole file and then encrypting the said sections of the compressed file; 

35 . A method according to claim 33, comprising the steps of selecting sections 
15 of the file, separately compressing and encrypting each section and providing each 
section with data at least identifying the section. 

36. A method according to any one of claims 32 to 35, comprising the steps of 
encrypting at least one section according to one encryption key, encrypting at least one 

20 other section according to another key, and storing data indicating the correspondence 
between the sections and the keys. 

37. A method according to claim 36, wherein the said correspondence data is 
stored in the first digital signal. 

25 , 

38. A method according to any one of claims 32 to 37, wherein the said data 
indicating the section boundaries identify the data included in the sections. 

39. A method according to any one of claims 1 to 37, comprising the step of 
30 compressing at least part of the said second signal and wherein the said combining step 

comprises combining the first signal with the compressed second signal. 
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40. A method accbrdiDg to claim 
16, whierein the said compressed second signal comprises auxiliary data space within 
the data structure thereof, and comprising the step of placing at least some of the bits 
of the first digital signal in the said auxiliary data space of the compressed second 
5 signal. 

41; A method according to claim 39 or 40, wherein the second signal is 
compressed according to an MPEG standard. 

10 42. A method according to claim 10 or 11, wherein the step of producing the 

first distal signal comprises receiving the digital signal from a streaming source, 
dividing the digital stream into segments each comprising a predetermined number of 
samples, and separately compressing and encrypting each segment. 

15 43. A method according tb claim 42, comprising encrypting all sections 

according to the same key or encrypting at least one section according to one 
encryption key, and at least one other section is encrypted according to another key 
and storing data indicating the coixespondence between the sections and the keys. 

20 44. A method according to claim 43, wherein the said correspondence data is 

stored in the first digital signal. 

45. A method according to claim 42, 43 or 44, wherein the first signal is 
combined with the said second signal by replacing, in samples of the second signal, the 

25 LSBs of the said second signal with the bits of the first signal. 

46. A method according to claim 45, wherein a predetermined fixed number of 
LSBs of a sample of the said second signal are replaced by the bits of the first signal. 

30 47. A method according to claim 46, wherein, in samples of the combined 

signal, the ratio of MSBs (representing the said second signal) to LSBs (representing 
the bits of the first signal) is variable. 




WO 2004/023471 W&Sf^ ^?^PCT/GB2003/003490 

31 




48. A method according to claim 47, wherein the said ratio is dependent on the 
amount of compression applied to the first signal. 

5 49. A method according to claim, 45, 46, 47 or 48, wherein the combined 

signal includes data indicating which hits of the combined signal are LSBs and which 
bits are MSBs. 

50. A method according to claim, 45, 46, 47, 48 or 49, comprising appending at 
10 least part of the first digital signal to the said second signal. 

51. A method according to claim 42, 43 or 44, comprising the steps of 
selecting groups of N samples and distributing over the N samples of each group 
cbrrespdnding sets of M bits of the first signal, where the ratio M/N is an integer 

15 fraction. 

52. A method according to claim 51, comprising the steps of 

a) scaling the value A of each of the N samples according to A'(X] = (A {X]/S) 
* S where: X is an ordinal numbering of the samples and equals 0 to N-l ; and S = 2 R 

20 where R is M/N; and 

b) replacing A' [X] by A"[X] = A' [X] + V /S x for X > 0, and 
by A"[0] = A*[0] + mod S for X = 0, 

where for each of X= N-l to 0, V is replaced by V-V/S x , V initially being the 
value of the M bits when X=N-1. 

25 

53. A method according to any preceding claim xx)mprising the step of 
recording the said combined signal on a recording medium. 



30 



54 r A method according to any one of claims 1 to 52, comprising providing 
the said combined signal to a signal distribution system. 



55. A method according to any one of claims 1 to 51, comprising providing 
the said combined signal to a transmission system. 

56. A computer program which when run on a suitable data processor 
causes the processor to implement the method of any one of the preceding claims. 

57. A storage medium storing a program according to claim 56. 

58. Apparatus arranged to carry out the method of any one of claims 1 to 

55. '■■ 

59. Apparatus for processing a digital signal comprising: 

an input for receiving a digital audio signal representing complete and 
unimpaired audio information; 

a compressor and encryptor arranged to compress and encrypt the said digital 
audio signal arranged to produce a compressed and encrypted first audio signal, the 
audio information of which is substantially unimpaired compared to that of the said 
digital audio signal; 

an input for receiving an unencrypted second audio signal; and 

a signal combiner arranged to combine the said first and second audio signals 

to produce a combined signal comprising the said compressed and encrypted audio 

signal and the unencrypted second signal. 

60. Apparatus according to claim 59, comprising a first signal producer 
operable to produce the said digital audio signal representing unimpaired audio 
information. 

61 . Apparatus according to claim 59 or 60, comprising a second signal 
producer operable to produce the said unencrypted second audio signal. 
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62. Apparatus according to claim 61, wherein the second signal producer 
comprises a signal impairer for impairing the said digital audio signal to produce the 
said second signal 

5 63. Apparatus according to claim 62, wherein the second signal producer 

comprises aL further combiner for combining the said digital audio signal with a further 
signal which degrades the said digital audio signal to produce the said second signal. 

64. A method according to claim 63, comprising a modulator for modulating 
10 the said further signal and wherein the further combiner is arranged to combine the 
modulated further signal with the said digital audio signal to produce the said second 
signal. 

65; Apparatus according to claim 64, wherein the said second signal is a 
15 sampled digital signal, each sample having most significant bits (hereinafter MSBs) 
and less significant bits (hereinafter LSIBs) and wherein the said signal combiner is 
operable to combine the first signal with the said second signal by replacing the LSBs 
of the said second signal with bits of the* first signal. 

20 66. Apparatus according to claim 65, wherein the said signal combiner is 

arranged to control the ratio of the number of LSBs to MSBs according to the 
compression ratio achieved by the said compressor. 

67. Apparatus according to claim 65 or 66, wherein the said signal combiner is 
25 operable to append at least part of the first digital signal to the said second signal. 

68. Apparatus according to claim 59, 60, 61 , 62, 63 or 64, wherein the said 
signal combiner is arranged to distribute the bits of the first signal oyer samples of the 
second signal in dependence on the ratio of the total number of encrypted bits in the 

30 encrypted first audio signal to the total number of samples of the said second signal. 
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69; Apparatus according to claim 68, wherein the said ratio is approximated by 
an integer fraction M/N where M/N is less than the said ratio, and comprising the steps 
r-of selecting groups of N samples and distributing over the N samples of each group 
corresponding sets of M bits. 

5 " -. . • ... .'• ' . .. . V ' - . . 

70. Apparatus according to claim 69, wherein the said signal combiner is 
arranged to implement the steps of 

a) scaliiig the value A of each of the N samples according to A' [X] = (A [X]/S) 
* S where: X is an ordinal numbering of the samples and equals 0 to N-l ; and S == 2 R 

10 wherfc R is M/N; and 

b) replacing A'[X]by^ 

by A'*[0] = A*[Q] + mod S forX-0, 

where for each of X= N-l to 0, V is replaced by V-V/S x , V initially being the 
value of the M bits when X=N-1 . 

is * : • ' 

71; Apparatus according to any one of claims 59 to 70, comprising a farther 
compressor operable to compress the said second signal, the said signal combiner 
being arranged to combine the said first signal with the compressed second signal. 

20 72. Apparatus according to claim 71, wherein the compression ratio of the said 

further compressor is dependent on the compression ratio achieved by the said, first- 
mentioned, compressor. 

73. Apparatus according to any one of claims 59 to 72, wherein the said 
25 compressor and encryptor is arranged to produce a losslessly compressed and 

encrypted first audio signal 

74. A data structure comprising a combination of a compressed and 
subsequently encrypted first digital audio signal, the audio information of which is 

30 substantially unimpaired, and an unencrypted second digital audio signal. 

75. A data structure according to claim 74, wherein the first signal is 
embedded in the second signal. 
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76 A data structure according to claim 74, in wliich the MSBs of the samples 
of the combined signal represent the second signal and the LSBs of the samples 
represent the first signal. 

5 • ■ ■ • ; •• - ' • • ■ ■ • • • ■•■ . • • ■ • ' 

77. A data structure according to claim 76, including data indicating the 
boundary between the LSBs and the MSBs. 

78. A data structure according to claim 76 or 77, Wherein the ratio of LS^s to 
10 MSBs per sample varies, 

79. A data structure according to claim 74, wherein the second signal is 
compressed according to a data format having auxiliary data space, and the first digital 
signal is in the auxiliary data space. 

15 ■ . . ■ — 

80. A data structure according to claim 74, 75, 76, 77, 78 or 79, wherein at 
least part of the first digital signal is appended to the second signal. 

81. A data structure according to claim 74, wherein the data is arranged in 
blocks each comprising a plurality of samples, the structure including data indicating 
the numbers of samples in the blocks. 

82. A data structure according to any one of claims 74 to 81, including data 
identiiying at least one encryption key used to encrypt the first digital audio signal. 

83. A data structure according to claim 81 or 82, wherein the blocks comprise 
groups of N samples and: sets of M bits of the first signal are distributed over the N 
samples of each group Where the ratio M/N is an integer fraction. 

30 84. A data structure according to claim 83, comprising data indicating the 

blocks. 
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85. A data structure according to any one of claims 74 to 84, wherein the 
second signal is an impaired version of the audio signal represented by the digital 
signal. 

5 86. A method of recovering a first signal from a combination of a first, 

compressed and encrypted, digital audio signal combined with a second signal, the 
audio information of the first audio signal being substantially unimpaired, the method 
comprising the steps of separating the first signal from the combination, decrypting 
the separated first signal, and decompressing the decrypted first signal to recover the 

10 substantially unimpaired audio information thereof. 

87 A method according to claim 86, wherein the first signal is represented by 
Less Significant Bits (LSBs) of the combined signal and the second signal is 
represented by the Most Significant Bits (MSBs) of the combined signal and 
1 5 comprising the step of discarding the MSBs to separate the first signal from the second 
signal. 

88. A method according to claim 87, wherein the first signal is appended to the 
second signal and comprising the step of discarding the second signal. 

20 

89. A method according to claim 86, wherein the second signal is a compressed 
signal compressed according to a format which has auxiliary data space in which the 
first signal is placed, and comprising the step of extracting the first signal from the said 
auxiliary data space. 

25 

90. A method according to claim 86, Wherein the first and second signals are 
combined by the method of claim 52, wherein the recovering method comprises, for 
each group of N samples, the steps of setting X = 0, setting V = 0, and replacing V by 
V= V + A'[X] modS*S x for each of X = 0 to N-l . 

30 

91. Apparatus for recovering a digital signal, the digital signal being 
compressed and encrypted and combined with a second sigpal, the apparatus 
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comprising a separator for separating the compressed and encrypted signal from the 
second signal, a decryptor for decrypting the separated signal and a decompressor for 
decompressing the decrypted signal. 

5 92. A program which when run on a suitable data processor implements the 

method of any one of claims 86 to 90 

93.; A storage medium storing a program according to claim 92. 

10 94. Apparatus arranged to implement the method of any one of claims 86 to 90. 

95. In a system comprising at least first and second processors, a method of 
transferring a digital signal representing content from the first processor to the second 
processor the method comprising the steps of: 
15 using the first processor to implement the method of any one of claims 1 to 58 

to produce the combined signal and to associate an identifier with the combined signal 
for identifying the combined signal; 
storing the said identifier; 

transferring the combined signal to the second processor; 
20 at fee said second processor, deriving the said identifier associated with the 

combined signal; 

subject to predetermined conditions being satisfied, trmsferring to the second 
processor at least one key associated with the said identifier, for decrypting the 
encrypted first signal; and 
25 using the second processor to separate the first signal from the second signal 

and to restore the first signal. 



30 



96. In a system comprising a transaction server and at least first and second 
clients, a method of transferring a digital signal representing content from the first 
client to the second client the method comprising the steps of: 
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using the first client to implement the method of any one of claims 1 to 58 to 
produce the combined signal and associating an identifier with the combined signal for 
identifying the combined signal; 

providing, to the transaction server, the identifier and at least one key for 
5 decrypting the encrypted sigrial and storing, in the transaction server, the said identifier 
and the said at least one key; 

transferring the combined signal to the second client; 
deriving the said identifier associated with the combined dgnal; 
transferring the identifier from the second client to the transaction server; 
10 subject to predetermined conditions being satisfied, transferring from the 

transaction server to the second client at least one key associated with the said 
identifier, for decrypting the enciypted first signal; and 

using the second client to separate the first signal from the second signal, and 
use the decryption key decrypt the first signal, decompress the decrypted to restore the 
15 digital signal. 

97. A method of processing a digital signal comprising the steps of 
providing a first digital signal representing first information, 
providing a second digital signal, arid 
20 embedding the first signal in the second signal by replacing Less Significant 

Bits (LSBs) of the second signal by bits of the first signal and retaining the More 
. Significant Bits (MSBs) of the second signal, 

whereby the first signal occurs as noise in the second signal. 

25 98. A method of processing a digital signal comprising the steps of 

providing a first digital signal representing first information, 
providing a second digital signal, and 

embedding the first signal in the second signal by selecting groups of N 
samples and distributing over the N samples of each group corresponding sets of M 
30 samples of the first signal, where the ratio M/N is an integer fraction. 



99. A method according to claim 98, comprising the steps of 
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a) scaling the value A of each of the N samples according to A*[X] - (A rX]/S) 
* S where: X is ah ordinal numbering of the samples and equals 0 to N-l; and S - 2 
where R is M/N; and 

b) replacing A'[X] by A"[X] - A' [X] + V/S x for X > 0, and 
5 by A"[0] = A'[0] + mod S for X = 0, 

where for each of X= N-l to 0, V is replaced by V-V/S x , V initially being the 
value oftheM bits when X=N-1.. 

100. A method according to claim 97, 98 or 99 wherein the first signal is a 
10 compressed signal. 

101. A method according to claim 97, 98, 99 or 100, wherein the first signal is 
an encrypted signal. 

15 102. A method of processing a digital signal comprising the steps of 

providing a first digital signal representing substantially unimpaired first 
information, the first signal being a compressed and/or encrypted signal, 

providing an unencrypted second digital signal representing second 
information, and which is compressed according to a compression format having 
20 auxiliary data space, and 

combining the first signal comprising the said substantially unimpaired first 
information with the second signal, embedding at least part of the first signal being 
embedded m me said auxiliary data space of the second signal. 

25 103. A method according to claim 102, wherein part of the first signal is 

appended to the second signal. 

104. A method according to any one of claims 95 to 103 wherein the first 
signal represents a computer program. 

30 

105. A method according to any one of claims 95 to 104 wherein the second 
signal is an audio signal. 
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106. Apparatus arranged to implement the method of one of claims 95 to 105. 

1 07. A computer program which, when run on a suitable computer or computer 
5 system, implements the method of one of claims 95 to 105 . 

108. A recording medium on which the computer program of claim 107 is 
recorded. 

1 0 1 09. Apparatus substantially as hereinbefore described with reference to the 

accompanying drawings. 

110. A method substantially as hereinbefore described With reference to the 
accompanying drawings 
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